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A new Viterbi decoder for convolutional codes with constraint lengths up to 15, 
called the Big Viterbi Decoder, is under development for the Deep Space Network, 
ft will be demonstrated by decoding data from the Galileo spacecraft, which has 
a rate 1/4, constraint-length 15 convolutional encoder on board. In this article, 
the. mathematical theory underlying the design of the very-large-scale-integrated 
(VLSI) chips that are being used to build this decoder is explained.. The deBruijn 
graph B n describes the topology of a fully parallel, rate 1/v, constraint length n + 2 
Viterbi decoder, and it is shown that B„ can be built by appropriately * wiring 
together * (i.e., connecting together with extra edges) many isomorphic copies of a 
fixed graph called a a B n building block * The efficiency of such a building block 
is defined as the fraction of the edges in B n that are present in. the copies of the 
building block. It is shown, among other things, that for any a < 1, there exists a 
graph G which is a B n building block of efficiency > a for all sufficiently large n. 
These results are illustrated by describing a special hierarchical family of deBruijn 
building blocks, which has led to the design of the gate-array chips being used in 
the Big Viterbi Decoder. \ ft \ 


I. Introduction and Summary 

The nth order deBruijn graph B n is the state diagram 
for an n-stage binary shift register. It is a directed graph 
with 2 n vertices, each labeled with an n-bit binary string, 
and 2” +1 edges, each labeled with an (n 4- l)-bit binary 
string. The vertex labels represent the contents of the 
shift register at a given point of time. The label on an edge 
connecting one vertex to another represents the contents of 
the shift register preceded by the bit that is being input to 


the shift register as it changes from one state to the next. 
Figure 1 is a representation of B$. 

The deBruijn graph B n gives the topology for a fully 
parallel Viterbi decoder for any rate l/i/ convolutional code 
with a constraint length of nH-2 ([3], Chapter 7). In such a 
decoder, a “butterfly” (a pair of add-compare-select units) 
must be located at each vertex of the graph and all commu- 
nication between butterflies takes place along the edges of 
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the graph. In fact, the Deep Space Network (DSN) is cur- 
rently developing such a decoder, called the Big Viterbi De- 
coder (BVD), for constraint-length 15 convolutional codes, 
to be used for the Galileo mission using a rate 1/4 code. 
The BVD has 2 13 butterflies connected according to the 
topology of B 13. It is constructed from 256 identical gate- 
array chips, each containing 32 butterflies. These chips 
are arranged on 16 identical printed-circuit boards, each 
containing 16 chips. Of the 2 14 “wires” (butterfly inter- 
connections) in the decoder, 56 percent are internal to the 
chips, another 17 percent are internal to the boards, and 
27 percent are inter-board, or “backplane” connections. 
Furthermore, these chips and boards are universal, in the 
sense that any deBruijn graph B n with n > 5 can be built 
from copies of these same chips, and any B n with n > 9 
can be built from copies of these same boards. In this ar- 
ticle, the theoretical background that led to the design of 
these chips and boards is given. See [1] and [5] for fur- 
ther details. (The BVD will be discussed at the end of the 
article — see Example K.) 

II. Preliminaries About Strings 

In this section, some notation is introduced and a few 
elementary facts about binary strings, which will be needed 
throughout the rest of the article, are established. 

Definitions. A binary string is a sequence of bits, 
i.e., Os and Is. The length of a binary string x , denoted by 
|*|, is the number of bits in x. The empty string e is the 
string with no bits. Thus, |e| = 0. The set of all strings of 
length n is denoted by {0, l} n . If x and y are two strings, 
the concatenation of * and y, denoted by xy or x*t/, is the 
string obtained by following the bits of x by the bits of y. 
If * = a * b * c, then a is called a prefix , 6 is a substring, 
and c is a suffix of x. If 6 * c isn’t empty, then a is called a 
proper prefix of x; if either a or c is nonempty, 6 is called 
a proper substring of x; and, if a * b isn’t empty, c is called 
a proper suffix of x. If x is a nonempty binary string, 
then the symbol x L (the left part of x) denotes the string 
obtained by removing the rightmost bit of x; similarly, 
x R (the right part of x) denotes the string obtained by 
removing the leftmost bit of x. 

If S and T are sets of binary strings, then S covers T if 
every string in T has a substring in 5. Similarly, S prefixes 
T if every string in T has a prefix in 5 . If T consists of a 
single string t , S covers or prefixes t. Also, S is irreducible 
if no string in 5 is a substring of any other. Finally, the 
cost of a set of strings S is cost(5) = Ylses > w ^ ere i 5 l 
denotes the length of the string s. 

Example (A). If x = 1011, then |x| = 4, x L = 101, 
and x R = Oil. The set 5 = {10, 111} covers {010, 100, 101, 


110, 111}, and {1,0000} covers {0, l} n for all n > 4. Simi- 
larly, {1,000} prefixes {1,00000}, and {0, 10, 110,111} pre- 
fixes {0,l} n for all n > 3. Also, {1,000} is irreducible, 
but {1,001} is not. The cost of the set {10,111} is 3/8, 
cost({l, 000}) = 5/8, and cost({0, l} n ) = 1, for all n > 1. 

Theorem (1). If S is an irreducible set of strings, 
then every string x covered by S can be factored uniquely 
in the form x = A sp, where s E S, A and p are (possibly 
empty) strings, and (As) L has no substring from 5. This 
factorization will be called the S -factorization of x. 

Proof: Since x is covered by 5, x will have one or 
more substrings from S. Among these 5-substrings, there 
will be a unique leftmost one, since no string in 5 covers 
any other. Call this unique leftmost 5-substring s. Then 
plainly, x = A sp is the desired unique factorization. 

Example (B). As noted above, 5 = {1,0000} is 
irreducible and covers all strings of length 4. The 5- 
factorization of 1010 is e*l*010, the 5-factorization of 0101 
is 0 * 1 * 01, and the 5-factorization of 0000 is e * 0000 * e. 

Lemma (1). If 5 is irreducible and covers {0,l} n , 
then every string x of length n or greater will have a unique 
5-factorization, and if x = A sp is this factorization, then 
|As| < n. 

Proof: Every string of length n or greater will have 
a substring of length n. This substring will be covered by 
5 and, hence, so will x. Now let x be a string of length 
> n, and let x = A sp be its 5-factorization, as described in 
Theorem (1). By definition of the 5-factorization, (As)*' is 
not covered by 5. However, if |As| > n, then |(As) L | > n, 
which would imply that (As) L is covered by 5, a contra- 
diction. 


III. deBruijn Graphs and Subgraphs 

The deBruijn graph B n , which is the state diagram 
for an n-stage shift register, can be described as follows. 
There are 2 n vertices, each labeled with an n-bit binary 
string x. There is a directed edge from the vertex with 
label x to exactly two other vertices, viz., those with labels 
Ox*" and lx*". The edge from x to Ox*" is labeled Ox and 
the edge from x to lx L is labeled lx. Similarly, there are 
exactly two edges directed into x, from x**0 and x**l, which 
are labelled xO and xl. This definition is summarized in 
Fig. 2(a). For example, in Fig. 1, from the vertex 101 
there are edges leading to 0(101)*" = 010 and to 1(101)*" = 
110. Equivalently, one can define B n by saying that it 
has 2 n+i edges, each labeled with an (n + l)-bit binary 
string, and that the edge labeled X connects the vertices 
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with n-bit labels X R and X L ■ This alternative definition 
is summarized in Fig. 2(b). For example, in Fig. 1, the 
edge labeled 1011 is a directed edge from (1011) = Oil 

to (1011)* = 101. 


Thus, 


eff(tf : G) = den(tf : G) 

= E(H)/E(G) 


Next, the notion of a subgraph of a deBruijn graph 
needs to be defined. In this definition, and later, the sym- 
bols E{G) and V(G) stand for the number of edges and 
vertices in the graph G ■ Thus, for example, E(B n ) — 2 
and V{B n ) = 2". 

Definition. If H and G are graphs, H is called a 
G-subgraph , written H C G, if H has the same vertex set 
as G and an edge set that is a subset of the edge set of G. 
The density of a G-subgraph H, denoted by den (H : G), 
is defined as den (H ■ G) = E(H)/ E{G) ■ 

Example (C). A B n -subgraph of density 0 consists 
of 2" isolated vertices, and a B„-subgraph of density 1 is 
B n itself. Figure 3 shows a 5 3 -subgraph of density 6/16, 
consisting of the eight vertices of B 3 and the six edges 

labeled {0010,0011,0100,0101,0101,0111}. 

Our goal is to build a large deBruijn graph B N by con- 
necting together multiple copies of a smaller graph, called 
a “building block.” If one thinks of the building blocks 
as very-large-scale-integrated (VLSI) chips, it is natural 
to want to minimize the number of edges needed to con- 
nect the building blocks together. This goal leads to the 
following definition. 

Definition. A graph H is a building block for a graph 
G if there exists G-subgraph H, which is the disjoint union 
of several copies of H. The efficiency of H as a building 
block for G, denoted by eff (H : G), is defined to be den (H : 
G). In other words, e ff ( H : G) represents the fraction of 
the edges of G that are accounted for by the edges in the 
building blocks. 

Theorem (2). If H is a building block for G, then 


eff (H : G) = 


V{G)E(H) 

V(H)E(G) 


= {E(H)(V(G)/V(H))/E(G) 

= (V(G)E{H)/V(H)E(G)) 

Example (D). Any B n -subgraph H is a building 
block of efficiency den( // : B n ) for B n . A B„-subgraph 
of density 0 is a building block of efficiency 0 for any Bn 
with N > n. A B„-subgraph of density 1 (i.e., B n itself) 
cannot be a building block for any larger deBruijn graph, 
since the disjoint union of 2 N ~ n copies of B n is a discon- 
nected graph with the same number of edges as B N , which 
is connected. In Fig- 4 are two copies of the graph H (from 
Fig. 3), relabeled and wired together with 20 new edges to 
form a graph isomorphic to B$. Since B$ has 32 edges, and 
the two copies of H together have 12 edges, it follows that 
H is a building block for fLj of efficiency 12/32 = 37.5 
percent. In fact, the graph in Fig. 3 is a building block 
of efficiency 3/8 for any B N with N > 3, as will be seen 
in Example (F), below. The building block of Fig. 3 is 
an example of what is called a universal deBruijn building 
block . 

Definition. A universal deBruijn building block of 
order n is a B„-subgraph that is a building block for any 
deBruijn graph Bn with N > n. 

The following theorem shows that it is easy to com- 
pute the efficiency of any universal deBruijn building block. 

Theorem (3). Let H be a universal deBruijn build- 
ing block of order n. Then, for all N > n, eff {H : B N ) = 
den (H : B n ). This common value will be called the effi- 
ciency of H as a deBruijn building block. 

Proof: By Theorem (3), the efficiency of H as a build- 
ing block for Bjv is 

„ > VjBs) E(H) 
eff(B .Bn) - E ( Bn ) y(tf) 


Proof: The G-subgraph H has the same number 
of vertices as G and is the disjoint union of several dis- 
joint copies of II . Since G has V(G) vertices, and H has 
V(H) vertices, this means that H is the union of exactly 
V(G)/V{H) copies of H. Since each of these copies of H 
has E(H) edges, 

E(H) = E(H)(V(G)/V{H)) 


2 n 2 n+1 den(B : B n ) 

= 2^+1 2 " 

= den (H : B n ) 

In the next section, a general construction for univer- 
sal deBruijn subgraphs is described (Theorem 4), and in 
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Section V (Theorem 9) it will be seen that there exist uni- 
versal deBruijn subgraphs whose efficiency approaches 1 
as n approaches infinity. 

IV. A General Construction for Universal 
deBruijn Subgraphs 

In this section, the main theorem (Theorem 4) is pre- 
sented, which gives a general construction for universal 
deBruijn building blocks. The key to this construction is 
a way of constructing a B n -subgraph from a set of strings 
of length < n. 

Definition. If S is a set of strings, B n (S) is defined 
to be the B n -subgraph obtained by deleting from B n all 
edges whose labels have a prefix in S. 

Lemma (2). If S is irreducible, E(B n (S)) = 2 n + 1 
x (1 — cost(S)); equivalently, den (B n (5) : B n ) = 1 — 
cost (5). 

Proof: The 2 n+1 edges in B n are labeled with the 
(n 4- l)-bit strings, and there are 2 n+1 of them. For each 
s G 5, there are exactly 2 n+1 “ l51 (n + l)-bit strings with 
s as a prefix. Since no (n + l)-bit string can have two 
prefixes in S (no string in S’ is a prefix of any other, since 
S is irreducible), the subgraph B n (5) will have exactly 
2 n+1 — Ylses 2 n+1 “l*l = 2 n+1 (l — cost(S)) edges. 

The main theorem of this article is the following. 

Theorem (4). If S is irreducible and covers {0, l} n , 
then B n (S) is a universal deBruijn building block of order 
n with efficiency 1 — cost(S). 

The proof of Theorem (4) is postponed until several 
examples have been given and a stronger but more techni- 
cal result has been stated and proved (Theorem 5). 

Example (E). The set 5 = {0, 1} is irreducible, has 
cost 1, and covers {0, l} n for any n > 1. The corresponding 
subgraph B n (S) is a B^-subgraph of density zero, and is 
plainly a building block of efficiency zero for any deBruijn 
graph with N > n. 

Example (F). The set S = {1,000} is irreducible, 
has cost 5/8, and covers {0, l} 3 . In this case, B 3 (5) is 
identical to the B 3 -subgraph in Fig. 3. Thus, Theorem (4) 
implies that the graph B 3 ({1, 000}) is a universal deBruijn 
building block with efficiency 3/8, as asserted in Exam- 
ple (D). 


The next theorem concerns a family of relabeled copies 
of the graph B n (5). If A is any binary string, the graph 
B n (S,A) is constructed from B n (S ) by inserting the string 
A into each vertex or edge label just after the first (left- 
most) occurrence of a substring from 5. In Fig. 5, this 
construction is illustrated for the graph B 3 ({1,000}). 

Theorem (5). For all N > n, 

(J B n (S i A) = B N (S) 

\A\=N-n 

Example (G). In Fig. 6, Theorem (5) is illustrated 
by showing the two graphs B 3 (5, 0) and B 3 (S, 1) for S = 
{1,000}. When taken together, these two graphs form the 
graph B 4 (S), which is a subgraph of B 4 . Thus, by adding 
the 20 edges whose labels have a prefix from S (16 with 
prefix 1 and 4 with prefix 000), B 4 is obtained, and indeed, 
this is how one arrives at Fig. 4. 

Proof of Theorem (5): Call the graph 

U B n (S,A) 

\A\ = N-n 

appearing in the statement of the theorem the union graph . 
To prove Theorem (5), one needs to show that the union 
graph is a Bn~ subgraph, and that its edges are exactly 
those whose labels have no prefix from S . To do this, one 
must prove the following four assertions (A always denotes 
a string of length N — n): 

(1) Every N- bit string occurs as a vertex label in 
some B rt (5, A). 

(2) Every edge in B n (5, .4) is an edge of the deBruijn 
graph Bn • 

(3) No edge label in B„(5,^4) has an S-prefix. 

(4) Every (N -f l)-bit string without an S-prefix ap- 
pears as an edge label on some B a (S, A). 

Taken together, (1) and (2) show that the union graph 
is a Bn -subgraph , and (3) and (4) show that the edge 
labels in the union graph are the (JV+l)-bit strings without 
an S-prefix. 

Proof of (1): Let X be an arbitrary iV-bit string, 
and let X = A sp be its S-factorization. By Lemma (1), 
|As| < n, so that \p\ > N - n . If the leftmost N - n bits of 
p are denoted by A y then p = Ap l and, hence, X = A sAp' . 
It follows that X appears as the label of the vertex A sp ( 
in B n {S y A). For example, if n = 3, S = {1,000}, and 
N = 8, the 8-bit string X = 01011110 has 5-factorization 
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0*1* 011110. The first five bits of 011110 are 01111, 
and so 01011110 appears as the label on vertex 010 in 
53(5,01111). 

Proof of (2): If an (n + l)-bit edge label x in B n (5) 
has 5-factorization x = Asp, then neither A nor p is empty: 

A isn’t empty, because no edge label in B„(5) has an 
5-prefix, and p isn’t empty, since |x| = n + 1, and by 
Lemma (1), any 5-factorization has |As| < n. Thus, in 
B„(5), an edge with 5-factorization Asp connects the ver- 
tices with labels (Asp) R = A R sp and (A sp) L = A sp L . Fur- 
thermore, this representation of the vertex labels must in 
fact be the 5-factorization of them, since an earlier occur- 
rence of a substring from 5 in either A R sp or A sp L would 
imply an earlier occurrence of an 5-string in Asp. This 
means that in the graph B„(5, A), the edge XsAp connects 
the vertices X R sAp = (AsAp) R and Asp^ = (As/lp) R . In 
other words, an edge with label X in B n (S,A ) connects 
X R to X L , and by the definition in Fig. 2(b), this is an 
edge in the deBruijn graph B n . For example, in Fig. (5), 
the edge with label OOIAO connects 001A0 R = 01A0 to 
001 j40 l = 001A, and this is an edge in the deBruijn graph 
S|yi|+ 3 , for any string A. 

Proof of (3): Let X be an edge label in the graph 
B n (S,A). Then by definition, X has the form X = A sAp, 
where Asp is the 5-factorization of an edge label in B„(5) 
with A nonempty. If X had an 5 prefix, say s', then either 
s' would be a prefix of Asp, or s would be a proper prefix of 
s'. But both of these alternatives are impossible: s' cannot 
be a prefix of Asp, since Asp, being an edge of B„(5), has 
no 5-prefix; and s cannot be a proper substring of s , since 
no string in 5 is a proper substring of any other. Thus, 
every edge in B n (5, -A) is an edge in Bjv(5), as asserted. 

Proof of (4): To prove that every (N + l)-bit string 
with no 5-prefix occurs as an edge label in B„(5, A) for 
some A, let X be such a string and let X = Asp be its 
5-factorization, in which necessarily A is nonempty. If 
A denotes the leftmost N — n bits of p, then as above, 
X = XsAp' . The string Asp' cannot have a prefix in 5, for 
if s' were such a prefix, then either s' would be a prefix 
of X , or else s would be a proper substring of s' (since 
A is nonempty), and both of these alternatives are im- 
possible. Thus, Asp' is the label on an edge of B n (5), 
and so X = XsAp' appears as the label corresponding 
to that edge in the graph B n {S,A). For example, let 
5 = {1,000}, n = 3, and N = 8, and consider the nine- 
bit string X = 001011100, which has no 5-prefix. The 
5-factorization of X is X = 00 * 1 * 011100. The first five 
bits of 011100 are OHIO, and so X appears as the label on 
the edge 001 in the graph Bz(S, OHIO). 

This completes the proof of Theorem (5). 


This section concludes with the proof of Theorem (4). 

Proof of Theorem (4): Theorem (5) explicitly 

shows that the union of 2 N “" copies of B„(5) forms a 
subgraph (namely, B/v(5)) of the big deBruijn graph Bjv, 
and so B N can be constructed simply by adding the edges 
missing from Byv to this union. Thus, B n is a universal 
deBruijn building block. According to Theorem (3), the 
efficiency of a universal deBruijn building block is the same 
as its density and, by Lemma (2), the density of B„(5) is 
1 — cost(5). 


V. Construction of Low-Cost Covers 
for {0,1}” 

In Theorem (4), it was shown how to construct univer- 
sal deBruijn building blocks from covering sets for {0, 1}" 
of small cost, but only a few examples were cited. In this 
section, several general constructions for low-cost covers 
for {0,1}" will be given, thereby automatically produc- 
ing [via Theorem (4)] efficient universal deBruijn building 
blocks. 

To produce a cover for {0,1}", begin with an arbi- 
trary irreducible set 5 of strings of length < n, which will 
be called a precover for {0,1}". In general, 5 will fail 
to cover a certain subset of {0, 1}", which will be called 
Omit„(5). Denote the number of strings in Omit n (5) by 
omit n (5). Plainly, if 0mit n (5) is adjoined to 5, the re- 
sulting set, denoted by C n (5), will still be irreducible, will 
cover {0,1}", and its cost will be cost(5) A 2“"omit n (5). 
This simple but useful construction is summarized in the 
following theorem. 

Theorem (0)* For any irreducible set 5 of strings of 
length < n, the set C„(5) is an irreducible cover of {0, 1}" 
of cost (cost(5) + 2“"omit n (5)). 

Example (H). If 5 — {1}, then Omit n (5) = 
{00 • ••0}, and omit„(5) = 1 for all n > 1. Thus, 
C„(5) = {1,00 •••0} is a cover for {0, 1}" of cost 1/2+2“", 
for all n > 1. 

Example (I). If S = {10}, then for n > 2, Omit n (5) 
consists of the n + 1 strings of the form 0 k * l n ~ k for 0 < 
k <n. Thus, omit n (S) = n + 1, and C n (S) is a cover for 
{0, l} n of cost 1/4 + (n + l)/2" , for all n > 2. 

Example (J). If S = {100, 1101}, then for n > 4, 
it can be shown that omit n (5) = 1 + (”) + ( 2 ) anc ^ th us i 
C n (S) is acover for {0, l} n of cost 3/16 + (l-h (”) -f ( 2 ))/2 n 
for all n >4. 
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If Theorems (4) and (6) are combined, it is found that 
if S is an irreducible set of strings of length < n, then 
D n (C n (S)) is a universal deBruijn building block of order 
n and efficiency 1 — cost(S') — 2“ n omit n (S). For simplicity, 
B n (C n (S)) is denoted by B n (S), and this fact is given as 
a theorem. 

Theorem (7). If 5 is an irreducible set of strings 
of length < n, then the graph B n (S ) is a universal de- 
Bruijn building block of order n and efficiency 1 — cost(S) 
— 2 _n om it n (5). 

The following theorem is a partial generalization of 
Examples (II) and (I). 

Theorem (8). Fix m > 1. If S m — {10 m-1 }, then 
as n — ► oo, omit n (S m ) = O(a^), where a m is the largest 
positive root of the equation z m — 2 z m ~ l +1 = 0, which is 
strictly less than 2. Thus, for all n > m, C n (S ) is a cover 
for {0, l} n of cost 2~ m + 0(a m /2) n , which approaches 2~ m 
as n — ■ * oo. 

Proof: According to [2], if m is fixed, the generating 
function fm{z) — En>0 omit n (5 m )z n is given in closed 
form by / m (z) = 1/(1"— 2 z + z m ). It follows then from 
the general theory of rational generating functions (see 
[4], Theorem 4.1.1), that omit n = O(0 n ) i where /? is the 
reciprocal of the smallest positive root of the equation 
1-2 z + z m = 0, which is also the largest positive root 
of the “reciprocal” polynomial P m (z ) = z m — 2 z m ~ 1 + 1. 
The largest root of P m (z) is strictly less than 2, since 
Pm( 1) = 0, P m (2) = 1, and P^(z) > 0 for z > 2. 

Corollary. If c n denotes the minimum cost for a cover 
for {0, l} n , then lim n _>oo c n = 0. 

Proof: Theorem (8) implies that for any m > 1, 
lim n _oo c n < 2 -m . 

Remarks. We conjecture, but cannot prove, that 
c n =0(1 /n). However, McEliece and Swanson, in a forth- 
coming paper, will show that c n = Q(l/n) and c n = 
0(logn/n). [The latter result is based on a more careful 
analysis of the type given in Theorem (8).] 

In view of the connection between covers for {0, l} n 
and universal deBruijn building blocks, the Corollary of 
Theorem (8) implies the following. 

Theorem (9). There exist universal deBruijn build- 
ing blocks whose efficiency is arbitrarily close to 1. 


Although Theorem (8) gives an infinite family of rea- 
sonably cheap covers for {0,l} n , it does not produce the 
cheapest possible covers for all values of n. Indeed, Table 1 
gives the cheapest known covers of{0,l} n ,for l<n<10 
and, therefore, also the most efficient universal deBruijn 
building blocks known, for orders up to 10. In every case, 
only the p recover S is given, it being understood that the 
actual cover is the larger set C n (S). Notice that for n < 7, 
the “10 • ■ - 0” construction of Theorem (8) gives the best 
cover known, while for 8 < n < 10 (and presumably for 
all larger values of n, too) the best cover is considerably 
more complicated. For 1 < n < 5, it is believed that the 
values in Table 1 are the best possible. For larger val- 
ues of n, however, improvements may be possible. For 
n > 8, the covers described in the table are based on 
the general “{100, 1101}” cover described in Example (J). 
For example, for n = 8, omit({ 100, 1101}) = 37, so that 
Cs({100, 1101}) is a cover for {0, l} 8 of cost 1/8 + 1/16 + 
37/256 = 85/256. However, by trial and error, it is found 
that of the 37 strings in Omit({100, 1101}), all but six 
are covered by {010101,010111,011111,0000001,0000101, 
0000111}. Thus, if {100,1101} U {010101,010111,011111, 
0000001,0000101,0000111} is used as a precover, Theo- 
rem (6) guarantees a cover of cost 1/8 + 1/16 + 1/64 + 
1 /64 + 1/64 + 1/128 + 1/128 + 1/128 + 6/256 = 72/256, as 
shown in Table 1. (Using {10} as a precover for precover 
for n = 8 results in a cover of cost 73/256.) 

VI. Hierarchical Building Blocks 

It has been seen that the universal deBruijn build- 
ing blocks described in Theorem (4) can be used to build 
deBruijn graphs of any size. Surprisingly, however, they 
can also be used as building blocks for larger universal 
deBruijn building blocks! This is useful in practice when 
many chips must be put on several boards, and the boards 
are then wired together to make the deBruijn graph. The 
main theorem here is the following. 

Theorem (10). Suppose Jc < n. If 5 is irreducible 
and covers {0, 1}*, T is irreducible and covers {0, 1}”, and 
if S prefixes T, then Bk(S ) is a building block for B n (T), 
Furthermore, 

effWS) : Bi.Cn) = 

Proof: Theorem (5) says that B n (S ) is equal to 

U MS, A) 

A:\A\-n-k 
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and so 5^(5) is a building block for B n (S). But since every 
string in T has a prefix in S, then B n (S) C B n (T)> so that 
Bjc(S) is also a building block for B n (T). To calculate 
efT(j9fc(S) : B n (T)), Theorems (2) and (4) are used: 

b mi MM 

eff(B fc (S) . B n {l )) - v r (S Jt (5))£:(S„(T)) 


2"2* :+1 (l — cost(S)) 
— 2 fc 2" +1 (l — cost(T)) 


1 — cost(S) 

1 — cost(T) 

Lemma (3). If S is any set of strings, and if k < n, 
then Cfc(S') prefixes C n (S). 

Proof: By definition, Cfc(S) = S U Omitjfc(S) and 
C„(S) = SUOmit„(S). A string s 6 Omit n (S) is a string 
of length n with no substring from 5. The fc-bit prefix of 
s is a string of length k, which also has no substring from 
S, and so this prefix is in Omit n (S). Thus, every string in 
C n (S ) is either in S or has a prefix in Omitjt(S). 

Theorem (11). If fc < n, then B k (S) is a building 
block for B n (S), and 


eff (B k {S) : B n (S)) = 


1 - cost(iS') - 2~ t omitt(5) 
1 — cost(5) — 2 _n omit n (S) 


Proof: The proof follows from Theorem (10) and 
Lemma (3). 

Example (K). Returning to the Big Viterbi Decoder 
mentioned briefly in Section I: the BVD requires the con- 
struction of the deBruijn graph B 13 using 256 one-chip 
realizations of the graph Bs({10}), which, by Theorem (7) 
and Example (I), is a universal deBruijn budding block 
of efficiency 18/32 (see Fig. 7), and so it contains exactly 

64 ’ 5§ = 36 ed 8 es - 

According to Theorem (11), B 5 ({10}) is a building 
block for B 9 ({10}) and, in the BVD, 16 of the S 5 ({10})- 
chips are wired together on a printed-circuit board to make 
a fl 9 ({10» board. Now S 9 ({10}) is a universal deBruijn 
building block of efficiency 374/512, and so it contains ex- 
actly 1024- |y| = 748 edges. However, 16 -36 = 576 of these 
edges are internal to the component chips, so that each 
S 9 ({10}) board actually has only 748 - 576 = 172 printed 
wires. Finally, since B 9 ({10}) has efficiency 374/512 as a 
deBruijn building block, in order to build B l3l there will 
be 2 14 -(l-§ff) = 4416 backplane wires, i.e., wires external 
to the board. In summary: 


Unit 

type 

Number 
of units 

Wires/ 

unit 

Total 

wires 

chip 

256 

36 

9216 

board 

16 

172 

2752 

backplane 

1 

4416 

4416 




16384 
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Table 1. Cheapest covers of {0,1 } n t for 1 < n < 10 


n 

Cost*2 n 

Efficiency 

S (pre cover) 

1 

2 

0.000 

{i} 

2 

3 

0.250 

{1} 

3 

5 

0.375 

{i} 

4 

9 

0.438 

{1} or {10} 

5 

14 

0.563 

{10} 

6 

23 

0.641 

{10} 

7 

40 

0.688 

{10} 

8 

72 

0.719 

{100, 1101, 010101, 010111, 
011111, 0000001 , 0000101 , 00001 1 1 } 

9 

127 

0.752 

{100,1101, 0000001 , 010101 1,0101111, 
0111111,00001011,00001111,01010101} 

10 

229 

0.776 

{100,1101,01010101,01010111,01111111, 
000000001 , 000000 1 01 , 0000001 1 1 , 
000010101,000010111,000011111} 


0000 



in i 

Fig. 1. The deBruijn graph fl 3 . 


(a) 




Fig. 3. A subgraph with density 6/16. In 
the notation of Section IV, this Is the graph 
S 3 ({1,000}). In the notation of Section V, it is 
the graph fla({l}). It Is a universal deBruijn 
subgraph of efficiency 3/6. 



Fig. 2. Two equivalent definitions of the de- 
Bruijn graph B n : (a) four vertices connected 
to the vertex labelled x (x Is an n-bit string), 
and (b) vertices at the left and right ends of the 
edge labelled X(Xls an (n + 1 ) - bit string). 
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Fig. 5 . The graph fl 3 (S, 4 ), obtained by Insert- 
ing the symbol A Immediately after the first oc- 
currence of a substring from S = {l , 000 } In the 
corresponding label In fl 3 (5) (Fig. 3). 


Fig. 4. Two copies of the 0 3 subgraph H from Fig. 3, relabelled 
and wired together to make B 4 (edge labels omitted). 
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> B 3 (S, 0) 


J 




> B 3 {S, 1) 


Fig. 6. illustrating Theorem 4.6: B 3 (S,0) U S 3 (S,1) = f? 4 (S) 
(compare with Fig. 4). 




1 



Fig. 7. One possible layout of the B 5 ({l0}) chip used to build the 
BVD. All edges are directed from left to right. The vertex labels 
shown are the decimal equivalents of the actual five-bit binary 
labels, and the edge labels have been omitted. 


190 




















